Distortion function and clustering for local linear models
نویسنده
چکیده
Principal component analysis (PCA) is a ubiquitous statistical technique for data analysis. PCA is however limited by its linearity and may sometimes be too simple for dealing with real-world data especially when the relations among variables are nonlinear. Recent years have witnessed the emergence of nonlinear generalizations of PCA, as for instance nonlinear principal component analysis (NLPCA) [1] or vector quantization principal component analysis (VQPCA) [2]. VQPCA involves a two-step procedure, namely a clustering of the data space into several regions and the application of PCA in each local region. In Ref. [3], VQPCA was applied for the reconstruction of dynamical response and it was shown that it is potentially a more effective tool than conventional PCA. The purpose of this technical note is to further investigate VQPCA and to have a closer look at the choice of the distortion function used for clustering the data space.
منابع مشابه
Presentation of quasi-linear piecewise selected models simultaneously with designing of bump-less optimal robust controller for nonlinear vibration control of composite plates
The idea of using quasi-linear piecewise models has been established on the decomposition of complicated nonlinear systems, simultaneously designing with local controllers. Since the proper performance and the final system close loop stability are vital in multi-model controllers designing, the main problem in multi-model controllers is the number of the local models and their position not payi...
متن کاملA new method for fuzzification of nested dummy variables by fuzzy clustering membership functions and its application in financial economy
In this study, the aim is to propose a new method for fuzzification of nested dummy variables. The fuzzification idea of dummy variables has been acquired from non-linear part of regime switching models in econometrics. In these models, the concept of transfer functions is like the notion of fuzzy membership functions, but no principle or linguistic sentence have been used for inputs. Consequen...
متن کاملVQ-Based Clustering Algorithm of Piecewise- Dependent-Data
In this paper a piecewise-dependent-data (PDD) clustering algorithm is presented, and a proof of its convergence to a local minimum is given. A distortion measure-based model represents each cluster. The proposed algorithm is iterative. At the end of each iteration, a competition between the models is performed. Then the data is regrouped between the models. The “movement” of the data between t...
متن کاملNew spatial clustering-based models for optimal urban facility location considering geographical obstacles
The problems of facility location and the allocation of demand points to facilities are crucial research issues in spatial data analysis and urban planning. It is very important for an organization or governments to best locate its resources and facilities and efficiently manage resources to ensure that all demand points are covered and all the needs are met. Most of the recent studies, which f...
متن کاملFast Non-Linear Dimension Reduction
We present a fast algorithm for non-linear dimension reduction. The algorithm builds a local linear model of the data by merging PCA with clustering based on a new distortion measure. Experiments with speech and image data indicate that the local linear algorithm produces encodings with lower distortion than those built by five layer auto-associative networks. The local linear algorithm is also...
متن کامل